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Abstract 

In the study of disordered models like spin glasses the key object 
of interest is the rugged energy hypersurface defined in configuration 
space. The statistical mechanics calculation of the Gibbs-Boltzmann 
Partition Function gives the information necessary to understand the 
equilibrium behavior of the system as a function of the temperature 
but is not enough if we are interested in more general aspects of the 
hypersurface: it does not give us, for instance, the different degrees of 
ruggedness at different scales. In the context of the Replica Symmetry 
Breaking (RSB) approach we discuss here a rather simple extension 
that can provide a much more detailed picture. The attractiveness of 
the method relies in that it is conceptually transparent and the addi¬ 
tional calculations are rather straightforward. We think that this ap¬ 
proach reveals an ultrametric organisation with many levels in models 
like p-spin glasses when we include saddle points. In this first paper we 
present the detailed calculations for the spherical p-spin glass model 
where we discover that the corresponding decreasing Parisi function 
q(x) codes this hidden ultrametric organisation. 

1 Introduction 

Some time ago we proposed mmm a method to introduce more control 
parameters (in addition to the temperature) in order to analyse the detailed 
ruggedness of an energy hypersurface of a disordered complex system. 
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In so doing we were following a long line of research that considers sys¬ 
tems composed of several real replicas (in addition to the virtual replicas of 
the Replica Trick) satisfying various constraints [3] [5j .Q U, .8]. 

Our proposal here pushes the assumption of ultrametricity to new levels 
as we will be investigating the distribution of saddle points consistent with 
ultrametricity. The skeptical reader may perceive this as an unintended and 
unjustified consequence of past successes with the hypothesis. We hope that 
the pragmatic reader will instead appreciate the elegance and simplicity of 
the calculations and join us in hoping that this extension be proved correct. 
In any case the cost of configurations that do not comply with ultrametricity 
can be analysed by other methods(see for instance jB, 0, E, ITU]). 

In pursuing this approach we were inspired by Derrida’s Generalised 
Random Energy model na where a multilevel ultrametric organisation built 
in the model can be revealed or hidden in the Gibbs-Boltzmann measure 
depending on the parameters of the model. 

Let us then imagine a configuration space partitioned in a hierarchi¬ 
cal way along an ultrametric tree with K + 1 layers labeled (0, 1...K) (K 
replica symmetry levels -hereinafter RSB- levels). The leaves of the tree are 
the ergodic pure states and define regions in configuration space limited by 
the Edward-Anderson overlap parameter qx = qEA- Each region is charac¬ 
terised by some kind of aggregate energy and by its size. These regions are 
then grouped in clusters limited by the overlap qx-i that defines a larger 
scale partition. These clusters are themselves grouped in superclusters in a 
scheme that continues along the tree. At each level we will have some kind 
of generalised free energy for every cluster/supercluster. The qk s satisfy 
Qk > Qk-i ■ ■ ■ > Qi > Qo- Then the generic question at any level of the 
tree is how many kth. clusters of overlap qk and generalised free energy F 
are contained in a higher level cluster of overlap qk-i and another partic¬ 
ular generalised free energy F'. This information is relevant, for instance, 
for the relaxation dynamics of the system or for the design of an efficient 
search algorithm of the minima and cannot, in general, be derived from the 
partition function 

Zj = Y^e~P Hj[c ] 

{C} 

where there is a single parameter (/3) because the sum aggregates informa¬ 
tion that one needs to keep apart. As usual the subscript J reminds us that 
in the definition of Hj there are an infinite number of random quenched 
parameters and that we are dealing with an ensemble of hypersurfaces. The 
results take the form of analytic expressions for average quantities including 
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correlations among local saddle points at variable distance in configuration 
space. From now on we omit the J subscript and unless explicitly stated we 
will be referring to quantities averaged over the J. 

The remaining of the paper is organized as follows: in section 2, sub¬ 
section 2.1, we first show how to introduce another parameter in addition 
to the temperature to desaggregate the contributions coming from states 
with different free energies and configurational complexity so as to ’’see” 
smaller or shallower states that would not contribute to Z because of their 
small weight and larger or deeper ones that do not contribute because of 
their reduced number.. At this point our method turns out equivalent to 
Monasson’s proposal [H| • The advantage of our approach becomes apparent 
in subsection 2.2 where a generalisation that adds up to K parameters is 
considered. 

In section 3 we present in full details the case of the p-spin spherical 
model for a hierarchical tree with 3 levels (K = 2 RSB levels). The gener¬ 
alisation for any K is straightforward. In this example we will use what is 
known about the solutions to the Thouless-Anderson-Palmer (TAP) equa¬ 
tions. We will show that the corresponding ultrametric tree is revealed by 
the monotonic decreasing x(q) function [6]. The presentation will show that 
in general, for any system, in a particular region of the constraint param¬ 
eters (when the number of real replicas is large enough) the free energy 
of the system per replica becomes equal to a saddle point solution of the 
unconstrained system. 

In section 4 we discuss some preliminary conclusions. 


2 The proposal: real replicas organised ultramet- 
rically 

To simplify the presentation we divide the proposal in 2 subsections and 
assume K = 2. It will become obvious how to generalise it for arbitrary K. 

2.1 Revealing the states when their statistical weight is too 
small 

In this case we consider the partition function of a system composed of R 
real replicas, all of which have mutual overlap q. Specifically: 

Z{P,R,q)= Y. n 5{C a -C a ,-q) (1) 
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where C a ■ C a > is the overlap between the configurations C a and C a ' and both 
a, a' run from 1 to R. At this moment R is larger than 1 and integer but, as 
usual, after the calculations we will derive an analytic expression and treat 
R as a real number. Now q delimits roughly a region: due to the properties 
of the energy hypersurface if a configuration has a finite weight there will be 
a relatively large number of configurations nearby that will also contribute 
to Z. Ultrametricity implies that these configurations lie inside a ball with 
maximum overlap qea • If q > qEA all the R replicas will be inside that ball 
and if q = qEA the entropy per replica will be maximal. The calculation is 
particularly simple in this case. Therefore we choose: 


We can also write 


dlog Z(P,R,q) 
dq 


0 =>■ q = qEA 


( 2 ) 


log Z(P,R) = 
Fs = Es 


PRE S + RS s + log A f s 
1 _ I d log Z(p,R) 

P s P OR 


logN s = logZ{P,R) + pRF s 


(3) 

(4) 

(5) 


where we identify E$ as the internal energy, Ss the state entropy while Ns 
is the number of states. 

These equations, equal to those in ref[HJ, separate the number of configu¬ 
rations per state and the number of states. They should be read in general as 
a definition of Fs , the free energy per replica, to be identified with previous 
definitions when the dependence of F$ in R is sufficiently small. Mathe¬ 
matically they reveal a multidimensional Legendre Transformation allowing 
a change of variables from R to Fs and therefore the number of states ex¬ 
pressed as a function of the free energy follows and the Legendre transform 
properties imply: 

d log Ns 


dF s 


= PR 


( 6 ) 


Parenthetically we observe that the lowest energy configuration in a state 
(the bottom of the corresponding valley) is determined implicitly by the 
equation: 


Ss{Ebottom) — 0 

(7) 

It is then evident that 


^bottom - E S dSs(Es) ~ Fs 

(8) 

dE s 
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So Fg is the linear extrapolation estimate of -Ebottom from an expansion of 
Sg around Eg. Similar arguments will apply going up along the tree, the 
free energy of a cluster will be a good estimator of the lowest free energy 
state inside the cluster. This is relevant for the feasibility of a hierarchical 
search, and is true in practically any system. In the last section with the 
conclusions we will discuss what goes wrong in p-spin glass systems: why in 
this case hierarchical search, for instance, simulated annealing will not work 
in spite of this general property. 


2.2 Clusters of states 


We now consider Ri replicas of groups of R 2 configurations such that the 
latter are constrained to have an overlap q 2 , while replicas belonging to 
different groups have an overlap q\ < q 2 - 

Now the number of states defined by q 2 is decomposed in two compo¬ 
nents: number of states belonging to a cluster A fs^V and number of clusters 

M v . 

Then 


Z(P, Ri, R 2 , qi, 92) = ^ e ^ a ’ bH[Cab] U a , b ^b'S(C a b-C ab/ -q 2 )Il a ^ alt b,b'S{.Cab-Ca'b'-qi) 


{C a b-,a=l.. .R^ ;6=1. ..i?2 } 


(9) 

where the indices a, a' run from 1 to R\ while the b, b' run from 1 to R 2 . We 
will again choose the q \, q 2 such that 


dlogZ(/3,R 1 ,R 2 ,qi,q2) _ dlogZ(/3,R 1 ,R 2 ,qi,q 2 ) 
dqi dq 2 


( 10 ) 


Then log Z is a function of only the R's and (3 and as in eq(§ can be 
decomposed into: 


log Z(j3, R \, R 2 ) = —j3RiR 2 Es + R\ R 2 Ss + Ri log A(s e v + log Ay (11) 


This equation, as eqQ should be read as a multidimensional Legendre trans¬ 
form and thus be complemented with 


dlogZ(f3,R 1 ,R 2 ) 

dR 2 

a log z(p,r 1 ,r 2 ) 

dR] 


Rif3F s 


f3F\; = R 2 (3 Fs + log A(seV) 


( 12 ) 


the meaning of which is rather transparent: the first equation reads as 
another definition of Fg, for a replica interacting with R\R 2 —\ other replicas 
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while the 2nd can be read as a definition of the free energy of a cluster. The 
equation corresponding to eqQ in this case is: 


d log J\fy 
dF v 


PRi 


(13) 


In these formulae log A f means log M rather than log A f. We will be using 
them where they are positive and extensive or at least the sum is positive 
and extensive. In the latter case, for instance if 


logA/y > 0; logAfseV < 0;logA/y > logA/s e y 

then we can read the log MseV-^V as the total number of states with free 
energy F$ contained in clusters of a certain free energy Ty 

We observe that configurations inside a state are weighed by the pa¬ 
rameter j3, while states inside a cluster use the parameter /3R.2 and clusters 
themselves /3RiR,2- 

The generalisation of this approach to a generic ultrametric tree with 
K total levels is now straightforward so we spare the reader a cumbersome 
notation. A warning however is worth repeating: as we have stressed we 
will choose all the overlaps q^s of the constraints to coincide with the saddle 
points of the system. This is the key to the simplicity of the calculations 
and implies that all relevant triangles among both real and virtual replicas 
satisfy ultrametricity. 


3 Calculations for the spherical p-spin glass 

In this section we detail the calculations for the p-spin spherical model. The 
Hamiltonian is |12| 


H ^ ' Jiii2—ip s ii s i2 • • • $ip ( 14 ) 

where the s* are real variables subject to a spherical constraint: (>T =1 N sj = 
1 and we have to calculate eq (9). 

We apply the canonical Parisi trick (jl2lj. E!)to derive the Free Energy 
per spin as a function of a nR\R 2 x nR\R 2 matrix 0“’^: 


nF = — 


P 

4 


£(°) p 

a/3 


^TrpnO] 


(15) 
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We can represent O as a matrix of matrices. The natural way to consider the 
O matrix is to order the columns (rows) lexicographically with 3 indicesrthe 
slowest one a indexing the clusters and running from 1 to R ±, then b indexing 
the states and running from 1 to i ?2 and finally j indexing the n virtual 
replicas. This generalises the parametrisation proposed in [ 6 j. 


O = 


/ O 11 ’ 11 
0 12 ’ n 


O 11 ’ 12 

( 912,12 


q11,1R 2 < 911,21 

q12,1R 2 ( 912,21 


Qll,RlR 2 

Q^2,RiR 2 


\qRiR 2 ,11 qRiR 2 ,12 


qR\R2^R2 QR 1 R 2 ?21 


qR\R2,RiR2 


(16) 

where O ab,a b s is a n x n matrix that encodes the overlap distribution of 
the ( ab ) with the (a'b') real replicas. The diagonal terms of these matrices 
satisfy the constraints: 


Diagonal terms of O ab,ab 

= l; 

Va, b 

Diagonal terms of O ab,ab 

= < 72 ; 

Va, b^b' 

Diagonal terms of O ab,a b 

= 91; 

Va / a',b,b' 


(17) 


Clearly up to this point nothing is imposed on off-diagonal terms that relate 
different virtual replicas. Then we make the natural ansatz: 


Qab,ab 

0ab,ab' 

Qab,a'b' 


Q Va, b 
P 2 Va, b^b' 

Pi Va^a', 6 / 6 ' 


(18) 


with Q, Pi, P 2 nxn Parisi matrices with the same block sizes mi x mi, m 2 x 
m -2 as in the standard RSB approach for virtual replicas with 2 RSB levels.. 
Once the limit n —» 0 is taken the corresponding functions q(x),pi(x),p 2 (x) 
will have the usual probabilistic interpretation. For instance the probability 
distribution of Cu ■C 12 will be encoded into P 2 (x). Therefore the 3 functions 
must be monotonous increasing for the formalism to make sense. 

We now restrict our consideration to the case where 


q{x) 

= q20(x — m 2 ) + qi0(m,2 — x)9(x — mi) 

(19) 

p 2 (x) 

= q(x) 

( 20 ) 

Pi(x) 

= qi9(x — mi). 

( 21 ) 


where $(•) is the Heaviside function and m 2 > m,\. There are 2 different 
levels of assumptions behind these ansatz, as stated in the previous section. 
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The first one has to do with the diagonal terms of the matrices being chosen 
equal to saddle point of log Z(/3, Ri, R 2 )- The second is that all triplets of 
configurations C a b, C a 'b', C a "b" obey ultrametricity. We conjecture, and we 
have checked it in some examples, that this 2nd statement is a consequence 
of the 1st one. 

It is basically this second assumption that simplifies the calculations 
because if all triangles are ultrametric then there must be a way to reshuffle 
rows and columns of O to write a new matrix O u explicitly ultrametric as a 
Parisi nR\R 2 x nR\R 2 matrix with 2 levels of Replica Symmetry Breaking. 
It is easy to check that this matrix will have block sizes m% x , rri\ T x 
with parameters = m 2 R 2 , = miRiR 2 ). The calculation of the 

log Z(f3, Ri, R 2 ) is then identical to the calculation for the unconstrained 
case just replacing the variables by the mf{ ones. 

From eq (57) in [6] we write: 


Iz = 


_ logZ(P,R 1 ,R 2 ) 


R 1 R 2 


4 


= ~^rU- mf) + gf(1 - m%) - 1} 


+ hi 


1 ln(S!) + ( 1 


m 


u 


m 


u 


1 01n(S 2 ) + (l-47)MS 3 )} 




77T,n 


( 22 ) 


where: 


51 = 1 - q 2 + m^(gr 2 - qi) + rn\ T q 1 

5 2 = 1 - q 2 + m%(q 2 - qi) 

5 3 = 1 -® (23) 


The saddle point (SP) equations will obviously be identical to the equations 
for the unconstrained system with two subtle differences: 

• The investigation of the fluctuations around the saddle point is com¬ 
plicated by the fact that some of the matrix elements are fixed by the 
constraints. 

• The saddle point values for the breaking locations apply to m% = 
m 2 R 2 ,rn 1 = miR\R 2 while the inequalities necessary for the proba¬ 
bilistic interpretation of the solution apply to rn 2 , m\. 

Therefore any solution to the saddle point equations can be interpreted 
probabilistically if: 
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(24) 


U,SP 

m l 

Pi 


< m 


U,SP 

2 


and 


m 


U,SP 


R2 


< 1 


which is always possible for sufficiently large R \, i ?2 • When this happens the 
log Z(f3, R ,\, R. 2 ) becomes equal to R 1 R 2 times the log Z of the unconstrained 
system and both logA/y and log A/sel 7 are zero. In fact when R\(R 2 ) grows 
we probe deeper clusters (states in the cluster) and eventually we hit the 
corresponding bottom configuration where logA/y (logA/sw) are zero. It is 
interesting to notice here that contrary to what happens in the SK model, 
in systems like p-spin glasses the lowest state in the lowest cluster lies higher 
in free energy that the absolute ground state. We will discuss this farther 
in the last section. 


3.1 R\ and/or R 2 below their critical values 

But even if we consider decreasing values of R \, R 2 reaching and surpass¬ 
ing their critical values R\ = m”’ P /m 2 ’ P ',R 2 = r n 2 ' SP we can still take 
advantage of the solutions of the free unconstrained system. 

In fact when R 2 (R \) approaches R\ {R'{) the probability of 2 states 
having overlap q 2 {q\ ) goes to zero as can be seen from the matrices Q 's 
and P’s. Physical arguments imply that the same must be true for smaller 
values. Therefore 

m u ' SP 

Ri < — }i~sp m i = m 2 => mi = R\rri2 

m 2 

R 2 < m%' SP => m 2 = 1 => m 2 = R 2 (25) 

This means that mi and/or m 2 hit a boundary and log Z(/3, R\, R 2 ) is not 
anymore stationary on them. The system behaviour is then described 
by the equations of the unconstrained system but with m/ ,m 2 
now as possible control parameters. There are 4 possible scenarios: 

1. Pi > Rl,R 2 > R c 2 . 

2. Pi > P^, R 2 < R 2 

3. Pi < P), R 2 > R 2 

4. Pi < Rl,R 2 < R c 2 
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In all 4 cases, defining Iz as in eq(21) we have: 


dlz 

dqi 

dlz 


dl/R 2 

dlz 


dl/(RiR 2 ) 


—— = 0 Saddle Point eqs in q \, q 2 
dq 2 

log A fs e v 
log A fy 


In case 1 in addition we have 2 more SP equations: 


dlz dlz 

dmJ( drn^ 

=> log A fsev = log Afy = 0 


( 26 ) 


(27) 


that detect the lowest free energy state in the lowest free energy cluster. 
In case 2 we have one more SP equation: 


dlz 

dm± 


0 =>■ log A/y = 0 


(28) 


and a new control parameter m% = R 2 that allows us to probe states in 
the lowest free energy cluster with varying free energies above the minimum 
one. 

In case 3 again we have one additional SP equation 


dlz dlz 

dm,2 1 dmJ( 


= 0 


=$■ logA/s e y Rl A/y = 0 


(29) 


and R\ as a control parameter to explore lowest free energy states in higher 
free energy clusters. 

In case 4, finally, there are no additional SP equations and instead we 
have 2 control parameters rn 1 / = R\R 2 and rnl{ = R 2 that explore higher 
free energy states lying in higher free energy clusters. 


4 The Saddle Point equations and their interpre¬ 
tation in terms of log Afsev an d logA/V* 


In principle one should first solve q\ , q 2 in terms of and then use 

eq( |ll|l2|27| ) to derive expression for other functions in terms of 
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But as the derivatives of log Z((3, R\, R 2 ) with respect to the q 's are zero it 
is simpler to take the first derivatives with respect to the m’s at constant q ’s 
and afterwards use the SP equations in q to choose any pair of independent 
variables to express our results. We borrow from section 4 of ref [6] the 
saddle point equations for K=2 of the spherical p-spin glass and a set of 
variables that are convenient because their SP values are independent of (3 


1. Variables: 


9 i S 3 p/3 2 p _ 2 2 

m = —; y i = 2/2 = 7^; J = ^- 9 2 (i-®) 

q 2 ^1 ^2 2 


2 . SP equations in qi,q 2 


PPl (n P- 1 _ = 9s ~ ®-i 

2 ((?s qs ~ l} [S s+ 1 S s ] 


s = 1,2 q 0 = 0 


that imply one equation among the new variables: 


i -p , w 1 1 - 1 

w-, — 1 = —-- 

2 / 12/2 


and another equation (3 dependent; 


P/5 2 p -2 _ 1 

2 <h S 2 Si 


P/5 2 p- 2 v2 
2 /i = 2 ( h s 2 


that implies a 2nd equation for Y 


2 —p 2 


(30) 


(31) 


(32) 


(33) 

(34) 


3. Variations with respect to 


~( m i ) 2 


dlz 

drn\ r 


~( m 2 ) 2 


dlz 

dm^ 


log A fy = 

-x(l - 2/1 + log2/1 + —-—) 

2 pyi 

log A fsev = 


(35) 


(36) 



- 2/2 + log 2/2 + 


(1 - y 2 f (1 - p{ 1 - wi)wf 1 - wf) ' 

P2/2 (1 -ioi)(l -w^ 1 ) 
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We remark the equality of the expression for the log A fy and the corre¬ 
sponding one for the log A /5 derived in [13], both of them independent of 
the temperature when expressed in terms of the corresponding variables: y± 
and Y = ( p/3 2 /2)q2 1 (1 — (ft ) 2 respectively. This fact is evidence that the 
multiplicity of states and clusters is connected to the multiplicity of solu¬ 
tions at T = 0, a fact that could be checked studying the TAP equations 
for the clusters derived from the Cavity Method. From nai we know that 
in the range of variations of Y the logA /5 is 0 when Y = 0.354993 for p=3 
while at Y = l/(p — 1) all states become unstable. The lower bound for 
yi is obviously the same but the higher one would depend on a stability 
analysis that has not been done, we are not distinguishing between stable 
or unstable clusters!]] 


5 Conclusions and future program 


Using eqs(32) and (34) we express log Afsev hr terms of Y and y\. In Figl(a) 
we show the contour plot of this function. We observe that the boundary 
of the region where there are an exponentially large number of states inside 
clusters has a positive derivative. This means that if we choose two clusters 
with different y± the one with the largest value contains states with larger 
Y, a non surprising result if as expected y\ and Y are related to the free 
energies of clusters and states. The same result is expected in a model 
like the Sherrington-Kirkpatrick model and should in general be true. In a 
cluster with lower free energy we expect to find the lowest free energy state 
because as proved by definition the cluster free energy is an estimate of the 
free energy of the lowest states inside it. 

On the other hand we observe that the lowest value of Y in Figl(a) lies 
around 0.43 a value much larger than the ground state value 0.354993 found 
in [ 6 ]. So the question: where is the ground state? This is explained in 
Figl(b) where we draw the contour plot of the log A fyNs^v, he. the log of 
the total number of states labeled by Y contained in all clusters labeled by 
yi and we witness a dramatic change of the derivative of the contour line 0 . 
What we are finding is that the number of clusters grows exponentially with 
yi at such a rate that even if the probability of finding a state with lower 
Y in a typical cluster goes exponentially to zero there remains a fraction of 
clusters that contain such states. This is exactly the picture suggested by 
the GREM and we believe it is common to all systems where one finds a 


1 In a work in progress by G. Parisi, F. Ricci-Tersenghi and M.A.V. we have shown that 

the Plefka stability criterion implies j/i < 1 /(p — 1) 
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Figure 1: (a) Contour-plot of logA fs^v as a function of y\ and Y. (b) 
Contour-plot of logA fs^v^S as a function of y\ and Y. 
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decreasing x(q). In fact in the linear approximation around the lowest state 
in the lowest cluster: 


logA f V {F v ) 9* Px(qi)(F v - F v> o) 

logA^ey(i^) = px(q 2 )(F s - F v ) (37) 

so the contour line 0 of Figl(b) 

logA fyNsev = 0 => x(q 2 )Fs + (x(qi) - x(q 2 ))Fv = constant. (38) 

Therefore x(q\) > x{q 2 ) for <71 < q 2 is telling us that an increase in Fy allows 
a decrease in F$. 

The calculation for the spherical p-spin determines the value of y\ (in 
Figl(b) for p = 3 around 0.41) that labels the lowest free energy clusters 
that contain the ground state. Unfortunately, and contrary to what we argue 
in a previous paper [ 2 ] it is not easy to use this additional information to 
improve on a possible hierarchical search of the ground state. At that value 
of yi the number of clusters is exponentially large even if with a smaller 
exponent and we have to visit all of them since only a very small fraction 
(in the limit just one) will contain the ground state. Furthermore there is no 
signal at that level of the search that reveals which are the good clusters. If 
the search inside a cluster could be done using gradient descent there would 
be some advantage but we do not think that even this happens. 

There are many things that remain to be done in the follow-up to this 
work. The most immediate is the analysis of the stability of the solutions 
of the constrained system. Another one is to apply the method to mixtures 
of different p’s spin glasses. There is also the idea of exploring alternative 
q(x) for these same systems. Further work on these aspects is the subject 
of present work (G. Parisi, F. Ricci-Tersenghi, M.A.V., in preparation) 
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